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1 Introduction 

The derivatives introduced by von Mises (1947) and their subsequent versions have wide 
ranging applications in statistics. Two prominent application areas are the construction of 
nonparametric confidence intervals and analytic bias reduction. 

Suppose we want to construct a nonparametric confidence interval of level a + 0(ra~ 3 / 2 ) 
for a smooth functional T(F) based on F say, the sample or empirical distribution for a 
sample of size n from F. Withers (1983) showed that the limit can be given in terms of 
integrals of products of von Mises derivatives evaluated at F. First one Studentizes using the 
asymptotic variance of n 1 / 2 {T(F) —T(F)}, a,2i(F) = [1 2 ]t = J^L. Tf{xi) 2 cIF(xi), where 
Tp{x) is the first derivative or influence function of T(F). 

Similarly, it is known that for smooth T(F), an estimate oiT(F) of bias 0(n~ 2 ) is T(F) — 
n 1 on(-^ 1 ), where an(F) = [11]t = J^ QO Tp(xi, xi)dF(xi) and Tp(xi,X2) is the second 
derivative of T(F). For convenience we refer to these integrals of products of derivatives 
like [1 2 ]t and [ll]r as bracket functions. 

Other recent application areas of von Mises derivatives include: least squares sup- 
port vector regression filtering methods, bootstrapping, functional principal components 
analysis, linearization and composite estimation, dimension reduction, quantile regressions, 



machine learning, cusum statistics, methods of sieves and penalization, change point es- 
timation, Hadamard differentiability, change-of-variance function, measuring and testing 
dependence by correlation of distances, empirical finite-time ruin probabilities (Loisel et 
al, 2009), nonparametric maximum likelihood estimators (Nickl, 2007), estimating mean 
dimensionality of analysis of variance decompositions, monotonicity of information in the 
Central Limit Theorem, generalizations of the Anderson-Darling statistic, M-estimation, 
{/-statistics (Volodko, 2011), information criteria in model selection, goodness-of-fit tests 
for kernel regression, empirical Bayes estimation, and estimation of Kendall's tau. 

The aim of this paper is to develop tools for extending the use of von Mises derivatives. 
In Section 2, we extend Faa di Bruno's chain rule for the derivative of a function of a 
univariate function to functions of a multivariate function and show how it can be applied 
to a function of a function of F, say T(F) = g(S(F)), where g : R a — > R is a smooth 
function and S(F) a smooth functional. 

In Section 3, we apply it to obtain derivatives and bracket functions for powers, products, 
quotients, standardized and Studentized functionals. 

Section 4 gives the general derivative for a moment and applies previous results to obtain 
expansions up to 0(n~ 2 ) for the distribution and quantiles of functions of sample moments. 
As an example we give the distribution of the standardized skewness for a normal sample 
to magnitude 0(n~ 2 ), where n is the sample size. Also we give confidence intervals and 
bias reduction methods for functions of moments. 

Some of the results in the paper follow easily from Withers (1983, 1987), see Theorems 
3.1 to 3.3. But these results are not the main contributions of this paper. The main contri- 
butions are: 1) the tools developed to compute von Mises type derivatives, see Theorems 
2.1 and 2.2; 2) their applications to obtain bracket functions for general functionals, see 
Examples 3.1 to 3.4 and Appendix A. The functionals considered by these examples in- 
clude T(F) = g(S(F)), where g is a univariate function, T(F) = S\(F)S2(F), a product 
of two functionals, Studentized forms of T(F) and T(F) = U(F)g(S(F)), where S(F) is 
real valued; 3) also the applications of Theorems 2.1 and 2.2 to obtain derivatives of central 
moments, see Theorem 4.1, Corollary 4.1, Corollary 4.2 and Appendix B. 

Fisher and Wishart gave unbiased estimates only for cumulants and their products: see, 
for example, Stuart and Ord (1987). Our two methods for bias reduction apply to any 
smooth functional - and our second estimate reduces to their results for the cases they 
consider. Also our method does not need to use unbiased estimates of cumulants to reduce 
the bias of functions of cumulants. 

Analogous to Fisher's tables for his fc-statistics and their cumulants, Appendix B gives 
the terms needed for bias reduction of any smooth function of one or more moments. 

2 Chain rules for functions and functionals 

Let s and g be real functions on R with finite derivatives. Comtet (1974, page 137) gives 
Faa di Bruno's chain rule for the rth derivative of 

t(x) =g(s(x)) 
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for r = 1, 2, . . . in the form 

r 

*M(x) = Xy fc >( S (s))fl pfc (s) (2-1) 

evaluated at s = (si, S2, • • •)> s « = s'^s), where B r h is the partial exponential Bell polyno- 
mial defined by the coefficients in the formal expansion in powers of real e, 

(oo \ 3 oo 

X>V*U /i!=^ £ r S rj .(s)/r! 
i=l / r=j 

for j > 0. Comtet (1974) shows they are given by 

B rj (s)/j\ = <^ ^-j ^ : ni H h n r = j, 1 • n x H hr-n r =r , 

n m N r 

where N = {0, 1,2,.. .}. Comtet (1974, page 307) tables them for r < 12. For example, 

fl r i(s) = s r , B rr {s) = s[, (2.2) 
B 32 (s) = 3sis 2 , B 42 (s) = A Sl s 3 + 3s 2 2 , B 43 (s) = 6s?s 2 . (2.3) 

Theorem 2.1 provides an extension of (|2.ip to the case s : M a — > M. b and g : M. b — > R. 



Theorem 2.1 Define the partial derivatives 

t.j v ..j r (x) = d r t(x)/dxj 1 ■ ■ ■ dxj r , 

^i'jvjr — ^i~ji"'jr 0*0 — & Sj(a;) / dxj 1 • • • dxj r , 

g-ji-jr(s) = d r g(s)/ds h ■ ■ ■ ds jr . 

The extension of \2. 1}) is 

r 

t. x ... r {x) = Y,9-h..4 h {s{x))Br^{s). (2.4) 
ft=i 

In \2.J$ and throughout, we use the tensor sum convention that repeated indices ii,i2,... 
are implicitly summed over their range (l,...,b in the case of \2.J$). 



Note that B l r } '" %h {s) can be written down on sight from B r ^. Some particular cases of 
Bi v ~ ih (s) can be obtained from flZSJ) and (1231) : 

B l r (s) = Si .i... r , B l r v " ir (s) = s ivl ■ ■ ■ s ir . r , 

3 

4 3 6 

Bl lt2 (s) = Sj r lSj 2 .234 + ^Sii-12Si 2 34, ^^(s) = ^ 1 Si 2 . 2 Sj 3 -34 ; 

where 

r 

ft-l... r = /li... r + h2— r l + • • • + h r i... r— 1- 
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A form of the multivariate chain rule (|2.4p was given in Withers (1984). 

Let J 7 be a convex set of probability measures on a measurable space (Q,A). Suppose 
for x € 0, that 5 X lies in F, where 5 X is the measure putting mass 1 at x and elsewhere. 
Let x, {xi} be points in £1. Let F lie in F, and T : F — > K be some functional. Define the 
rth derivative of T(F) at {x\, ... ,x r ), 

T.i... r = T F (xi ■ ■ ■ x r ) = TP (xi, . . . , x r ) , 

as in Withers (1983). The only derivative we need give here is the first, also known as the 
influence function: 

T. 1 (x 1 )=T F (x 1 )=lim{T((l-e)F + e5 Xl )-T(F)}/e. 

For example, T(F) = g(x)dF(x) has first derivative T.\ = T.\{x) = g{x) — T(F). 
The results stated in Withers (1983) for f2 = M s generalize immediately to general 0,. In 
particular, the rule (|2.1ip for the derivative of the rth derivative may be stated as 

r 

(T.l- r ) r+1 = T. X ... r+1 - ^ [T.l-r+l]i , (2.5) 

i=l 

where [T.i... r+ i]i = T.\... T+ i with the ith argument dropped. So, 

(T. X ) 2 = T. 12 -T. 2 , 

(^•12)3 = T.123 — T.23 — T.13. 

In this way higher derivatives may be calculated from successive first derivatives. For 
example, the second derivative of J_ g(x)dF(x) is zero. Now suppose for some function 
g : R b -»• R, 

T(F) = g (5(F)) where S(F) is a real functional in M. d . (2.6) 
Applying (|2.5p gives 

T.i = g-iSi.!, (2.7) 

T.12 = g-iSi-12 + g-ijSi.iSj.2, (2.8) 

3 

T.123 = g-iSi-123 + g-ij ^2 + g-ijkSi-lSj^SkS, (2.9) 

and so on, where S a .i2... is the rth derivative of S a (F). Despite the fact that by (12. 5p the 
derivative of a derivative is not a second derivative, the expressions (|2.7p - (|2.9p are precisely 
those for the derivatives of a function of a vector function of a vector given in (I2.4h , That 
is, 

r 

T. 1 ... r = Y / g. il ... lh (S(F))Br- lh (S), (2.10) 

h=l 

where S = (Si, 52,...), Si = S^ l \F). A proof that (I2.10p holds for general r follows using 
(|2.5p and induction. The result can be formally stated as follows. 
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Theorem 2.2 If \2. 6\) holds, T.\... r is given by the chain rule for 

T.!... r = r.i... r (s) = d r T{x)/dxi ■■■dxr 

when T(x) = g{S{x)) for S{x) : W -»■ R d with S^r = Si. x ... r {x) = d r Si{x)/d Xl ■ ■ ■ dx r 
re-interpreted as Sip(xi ■ ■ ■ x r ) and S(x) as S(F). So, 



m(n) 



(2.11) 



h=l 



n n 



where g.i v -i h = g.i v -i h (y) = d h ■ ■ ■ d ih g(y) at y = S{F) for = d/dy i} £) n sums over 
n = (ni • • • n r ) G N r satisfying Y7i=i n i = ^> Yli=i = r > m ( n ) = r '/ Yli=i tt ni ni\, the 
partition function, and Yin sums over all partitions (Hi • • • Uk) of (1 • • • r) with i H's of 
length m. 

Corollary 2.1 applies Theorem 2.2 to obtain the next two derivatives. 
Corollary 2.1 We 

/ 4 3 \ 

9-iSi-X2U + 9-i\ii I ^2 ^U- 1^2 -234 + Si 1 .i2<S'i2-34 J 

6 

+9 •«l«2«3 ^ 1 5'ii-l'S'i2-2'S'i3-34 + 5 , -ii---«4'5'il-l'S'«2-2'S'i3-3'S'i4-45 
/ 4 10 \ 

T.12345 = .'/ "S i ". + 9 i\h I ^ 5'ii-l5'i 2 .2345 + ^ «Si r 12'S , i 2 .345 J 

/ 10 15 \ 

I ^ S , i 1 .i5j 2 .25i 3 .345 + ^ 5'j 1 .iS'j 2 .235'i3-45 J 

10 

+5 , -«i - «4 ^ ] 5'ji-l'S'i2-2'S'i3-3'S'j4-45 + 9-ii—isSii-l ' ' ' Si 5 -5, 



■1234 



.SO 



T 



[11] T = ff.ttlljsi + 9-i9-j [Si-iSj.i] , 
[1, 2, 12] T = H i U i/J i,, [S^.iSi^Si^] + 9-ii9 i29-izii [<S'ii-i'Si3-l] [S^-iSi^i] 



[in] T 

[1122] r 



[1,122], 



[l2 2 ] 



9-i[m]s t + 3fif.ij [5j.i5j.ii] + g.ij k [iSt.i5 3 -.i5fc.i] , 
^[1122]^+^ (4 [^.1^.122] + 2 [5^.12^.12] + [!%[!%) 

+25-jii 2 j3 ( 2 [5i 1 .i<S'i 2 .2S'j3.i2] + [S^.iS^.i] [ll]s i;j ) 

+5'-u---«4 [*S''ii-l*S'i2-l] [5i 3 .l5i 4 .l] , 

9i9 j [Si.1Sj.122] + ([Si-iSj.i] [ll]s fc + 2 [Si.1Sj.2Sfc.12]) 

+9-i9-jki [Si-iSj.i] [Sk-iSn] , 

9 i9 j [Si.121Sj.12] + 2g-i9 jk [Si.12Sj.1Sk.2l + 9-ij9-ki [Si-iSk-i] [Sj.iSi.i] , 
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and so on, where 



[Si.iSj.i]= Si.iSj.idF (xi) , 

J —CO 

/oo rco 
/ Si^Sj.iSk.^dF (xi) dF (x 2 ) , 
'OO J — oo 



and so on. 



3 Some applications 

Let F be the empirical distribution of a random sample of size n from F. By Withers 
(1983), for a broad class of T, the cumulants of T(F) satisfy 



oo 



i=r—l 



for r > 1, where the cumulant coefficient a r i(T) = a r i is a certain function of the derivatives 
of T(F). The most important are aio = T(F), 

a 2 i= [1 2 ] T = [2*], (3.1) 
a n = [ll] r /2 = [T. n ] /2, (3.2) 
a 3 2 = [1 3 ] T + 3[1, 2, 12] r = [T.3] + 3 [T.iT. 2 T.i 2 ] , (3.3) 

where 

/oo 
f(T. 1 ,T. 11 ,...)dF 1 (x 1 ), 
-oo 

[/ (T'.i,T. 2 ,r.ii,r.i 2 ,r. 22 ,r.i 22 , . . .)] 

/CXD /'OO 
/ / (T.i, T. 2j T.n, T.12, T.22, T.122, • • •) d^i (*i) dF 2 (x 2 ) , 
-OO J —CO 

and so on, for Fj = F(xi), and 

1 ^ oi 11^ 10^ oo m T 1 ^ T^J T 1 ^ 

1 , Z ,11 , 1Z , ZZ ,..•] - ^-1; J . 2 ) J -11) J -12i 1 -22; ■ ■ -J > 

and so on. We refer to the functionals [■ ■ ■ ] as bracket functions. They are the building 
blocks for the cumulant coefficients a r i and the cumulant coefficients of the Studentized 
statistics, and hence for the Edgeworth-Cornish-Fisher expansions of the standardized form 
of T(F), 

Y n = (n/a 21 ) 1/2 {T (f) -T(F)} , (3.4) 

and its Studentized form. They are also the building blocks for obtaining nonparametric 
confidence intervals and estimates of low bias for T(F). 

As a start we have these approximations to the bias, variance, and skewness of T(F): 

T(F) + n- 1 a 11 + 0(n- 2 ) , 
= n~ 1 a 2 i + O (n~ 2 ) , 
- 2 a 32 + O (n" 3 ) , 



E 



var 



^3 



t(f) 



n 
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where fi 3 [X] = E[(X - E[X]) 3 ]. 

Theorem 3.1 lists the bracket functions needed for bias and bias reduction. Theorem 

3.2 lists the bracket functions needed for Edgeworth-Cornish-Fisher expansions. Theorem 

3.3 lists the bracket functions needed for nonparametric confidence intervals. 

Theorem 3.1 Under regularity conditions, 



E 



T F 



a n = [H]t/2, 

012 = [lll] T /6 + [1122] T /8, 

013 = [llll] r /24+ [1122] T /12 + [11223% /48, 

and so on. The estimates ofT(F) of bias 0(n~ J ) are 

i j 
T{F)+^ n ~ iT i\f) andT(F^+^Si[F) /in-1% (3.5) 

i=l ' i=l 

where (m)i = m\/[m — i)\ = m[m — 1) • • • (m — i + 1) and 

T 1 (F) = S 1 (F) = -[ll] T /2, (3.6) 

T 2 (F) = [lll] r /3 + [1122] T /8 - [H]t/2, (3.7) 

T 3 (F) = -[ll] r /2 + [lll]r - [UH]t/4 + 3[1122] T /4 - [11122] r /6 - [112233] T /48, 
S 2 (F) = [lll]r/3+ [1122] T /8, 

S 3 (F) = -[llll] r /4 + 3[1122] T /8 - [11122] T /6 - [112233] T /48. 
Proof: Follows by equation (2.4) of Withers (1987). □ 

Theorem 3.2 T/ie 'reduced' Edgeworth and Cornish-Fisher expansions of T(F) to 0{ 
n -U+ 1 )/ 2 ) needs 

for j = : 021, 

for j = 1 : an and a 32 , 

/ori = 2:a 22 = [1,11] T + [12 2 ] t /2+[1,122] t , 

a 43 = [l 4 ] T ~ 3 [l 2 ]?, + 12 [1, 2 2 , 12] T + 12[1, 2, 13, 23] r + 4[1, 2, 3, 12%, (3.8) 
and so on. In particular, for Y n of [3^M, under regularity conditions, 



P(Y n < x) = -4>{x) n- 1/2 fn(x) +n- 1 h 2 {x) +C>(n" 3/2 ) 

fork! = A u +A 3 2He 2 /6 and hi = (A 22 +Aj 1 )He 1 /2+( y A 43 +AA 11 A 3 2)He 3 /2A+Al 2 He 5 /72, 
where <fi are the distribution and density of a unit normal random variable, He r is the 
rth Hermite polynomial, and A r { = a r j/a 2 i , the standardized cumulant coefficient. 

Proof: Follows by Withers (1983). □ 

The regularity conditions needed for Theorems 3.1 and 3.2 are the same as those given 
in Withers (1983, 1987). So, they are not stated here. 
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Theorem 3.3 A confidence interval for T(F) of level 1 — a + 0(n (• ?+1 )/ 2 ) requires the 
bracket functions 



for j = 
for j = 1 
for j = 2 



a 21 ~ I--- j T 
3 



[I 2 ] 



11] T , [1 3 J t , [1,2,12] t , 
1, 11] T , [12%, [1, 122] T) [l 4 ] T , [l, 2 2 , 12] T . 
[1,2, 13,2%, [1,2, 3, 123] T . 



(3.9) 



Proof: Follows by Theorem 5.1 in Withers (1983). □ 

By Withers (1989), the bracket functions in Theorem 3.3 are also the terms needed for 
the distribution and quantiles of the Studentized form of T(F) to 0(n~^ +1 ^ 2 ). 

For the distribution of | T{F) — T(F) | to 0{n~i~^) or for a symmetric confidence 
interval for T(F) of level 1 — a + 0(n~i ) one needs, by equations (2.4) and (2.5) of 
Withers (1982), 021 for j = and an, 032, 022, 043 for j = 1. 

For convenience, set T = T(F) and = g( l \S(F)) for 5(.F) in R. 

Example 3.1 This example gives bracket functions for a function of a univariate func- 
tional. Suppose \2. 6\) holds with 6 = 1. Then 



T.x 
T. 12 

T.123 
T.1234 



giS.i, 

g\S.\2 + g2S.1S.2-, 



•12345 



giS-123 + 52 -5.i5.23 + 53 5.1 5.2 S. 3, 

51 5.1234 + 52 I ^ 5.i5.234 + ^ 5.125.34 J 

6 

+53 5.i5.25.34 + g^S.xS^S.^S.^ 

9lS.l...5 + 52 I ^ 5.i5.2345 + ^ 5.125.345 J 

/ 10 15 \ 10 

+53 I ^2 S.1S.2S.345 + ^2 S.1S.23S.45 J + 54 ^ 5.i5.25.35.45 + 355.1 • • • 5.; 



So, 



g\ 



21 2 



[l% = 5 i[ll] 5 + 52 [l 2 ] s , 
[1,2,1% = g\\\,2,\2\s + g\g2 [l 
[111] T = 5i[Hl]s + 3 52 [1, H]s + 53 [l 3 ] s , 
[112% = Oi[1122] s + 52 (4[1, \22\ s + [11]| + 2 [l2 2 ] 5 ) 



+2 53 ([l 2 ] s [ll]5 + 2[l,2,12] 5 )+54[l 



21 2 



[1,12% = 5 2 [l,122]5 + 5i52([l 2 ] s [lll]5 + 2[l,2,12] 5 ) + 5 i53 [l 



21 2 



[12 2 ] T = g\ [12 2 ] s + 25i 5 2 [1, 2, 12] s + <? 2 [l 21 2 



s ■ 
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Example 3.2 This example gives bracket functions for a product. Suppose that T(F) 
S 1 {F)S 2 (F). Then 

(2) 

T.i = 5 2 'S'm + ffi^ i = ^ SiSi.i say, 

T.12 = {S2S1.12 + S1S2.12) + {S1.1S2.2 + 5 , 2.l5'l.2) 

(2) 

= (>S l 2'S l i.i2 + Sifla-^) say, 

3 

T!i23 = (5 , 2'S'l-123 + 5'i<S , 2.l23) + ^ (^i. 1-52.23 + <S2.I1S1.23) 
(2) (6) 

= ^2s 2 S 1 . 1 23 + ^2Si.iS 2 .23 say, 

4 

^■1234 = (5 , 2'S'l-1234 ■1234) + ('S'l-l'S'2-234 + S2.lS1.234) 

3 

+ ^ (Sl.i2S2.34 + £2-12<Sl-34) 
(2) (8) 6 

= ^ 5'2'S'l.l234 + "5l-l'52-234 + ^ <S1.2S2.34 SO?/- 

So, 

(2) 

[1 2 ] T = ^5 2 2 [l 2 ] 5i + 2 < S 1< S 2 [5 1 . 1 5 2 . 1 ], 

(2) 

[11] T = 25 2 [ll] Sl +2[5 1 . 1 5 2 . 1 ], 

(2) 

= £(s 2 3 [l 3 ] 5i +3S 2 2 [S 2 .iS 2 4 
[1,2,12] T = Y,^ S l^^ U h 1 + SiS 1 (^[S 1 . 1 S 1 .2S2.i2] 

+2 [5i.i5 2 . 2 5i.i 2 ] j + 2S 2 [l 2 ] Si [S hl S2.i] I 
+25 1 5 2 ([5 1 . 1 5 2 . 1 ] 2 +[l 2 ] 5i [l 2 ] Sa ), 

(2) 

[111] T = £(S 2 [lll] 5i +3[S 2 .iSi.n]), 

(2) 

[1122] T = (S 2 [112% + 4 [5M52.122]) + 2 [1% [1% + 4 [S1.12S3.12] • 

Example 3.3 This example gives bracket functions for a Studentized function. The Stu- 
dentized form of T(F) is 

-1/2 



T (fj=v(fj (t(f)-T(F)} 



for V(F) = a 2 i. Its bracket functions [• • ■ ]r if and so also its cumulant coefficients) may be 
expressed in terms of the bracket functions [■ ■ ■ ]r- For details, see Appendix A of Withers 
(1989). 
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If one makes other assumptions such as symmetry of F or a parametric form for F, 
then V{F) = a 2 \ will generally take a simpler form. Similarly, in some circumstances one 
is interested in standardizing a functional in a different way, for example, replacing fj, r by 
Hr/fj^/ 2 - The next example covers this situation for the special case of a T(F) a function 
of a univariate functional. 



Example 3.4 Suppose that T(F) = U(F)g(S{F)) with S(F) in R. Then 
T.i = goU.i + giUS.i, 



■ 12 



g U. 12 + gi (uS. 12 + £ E/.1&2J + 92US. 1 S. 2 , 



I (6) 
T-1%2, = goU.123 +91 \U 5.123 + ^ U-lS-23 

3 

+92 ^ ( US l S -23 + U.1S.2S.3) + g 3 US.lS. 2 S. 3 , 

f (8) 6 

^■1234 = 90^1234 + 9l I ^5.1234 + ^ ?7-l<S'-234 + ^ ^•12<S'.34 



/ 4 3 12 6 \ 

+ 52 f [/ Y, 5-15.234 + C/ ^ 5. 12 5. 34 + ^.l5.25. 3 4 + £ E/.U&g^ 

/ 6 4 \ 

+93 I U Y s i s -i s -34: + Y u - lS - 2S - 3Si + giUS.iS. 2 S. 3 S.4. 

So, the cumulant coefficients a 2 \, a\\, a% 2 needed for third order inference are given by 
\3. l\) - [373\) in terms of the bracket functions 



[1 2 ] T = g 2 [l 2 ] u + 2g g 1 U[U. 1 S. 1 ]+g 2 1 U 2 [l 2 ] s , 
[11] T = go[n} u + g 1 (U[ll] s + 2[U. l S. 1 }) + g 2 U[l 



\S 



[1 3 ] T = g 3 + Zg 2 gi U [U\S. X ] + 3g g 2 U 2 [U.tS\] + gfU 3 [l 3 ] s , 
[1, 2, 12] T = 9o 3 [1, 2, 12] j, + 5o 2 «?i (17 [U. x U. 2 S. l2 \ + 2 [l 2 ] ^ [U.tS.x] + 2tf [C/.iS. 2 C/. 12 ]) 

+<7 2 52 f/ [U.iS.i] 2 + g glU^2 [U.^] 2 + 2 [l 2 ] v [l 2 ] s + 2U [C/.iS. 2 5. 12 ] 
+*7[S.lS. 2 £/.i 2 ] j +2 50 <7i92t/ 2 [tfiS.i] [1 2 ] 5 + <??^ 2 ^[1,2,12] 5 
+2[tti&i] [l 2 ] 5 ^+<7 2 52 f/ 3 [I 2 ]'. 



Similarly, the cumulant coefficients a 22 , 043 needed for third order inference are given by 
Ii3. 8\) in terms of the bracket functions given in Appendix A. The bracket functions needed 
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for nffljil . [3^\) for estimates ofT(F) of bias 0(n" 3 ) are 



[111] T = 5 o[lll] C / + <?i(^[lH] 5 + 3[f/.iS.ii] + 3[C/.ii5.i]) 
+3 52 (C/ [1, 11] 5 + [U.^l]) +g 3 U [l 3 ] s , 

[1122] T = ff0 [1122] [/ + ffl ^C/[1122] 5 + 4[i7. 1 5.i22]+4[C/.i225.i] 

+2 [1% [11] s + 4 [Z/.ia&ia] j + 52 [1, 122] s + 17 [11]| + 2C7 [l2 2 ] s 

+8 [tr.xS.a&iz] + 4 [5x5.2rj.i2] + 4 [U.iS.i] [11] s + 2 [1% [l 2 ] 5 \ 

+2g 3 (U [l 2 ] g [11} S + 2U [1, 2, 12] 5 + 2 [tr.x5.x] [l 2 ] g ) + g 4 U [l 2 ] * . 

Further terms are given in Appendix A. 

If g(s) = s r then gi = (r)j5 r_l . Putting r = — 1 gives the derivatives of a quotient 
(-l)i = {-1)HL 



4 Applications to moments 

Suppose 1 ~ F on 1. Set /i = E[X], /i r = ELY r ] and let {fj, r , K r } be the central moments 
and cumulants of F. Set fi(F) = \x and so on. Let F be the empirical distribution of a 
random sample of size n from F. 

Many authors have studied problems of moments and cumulants: see, for example, 
Stuart and Ord (1987). Fisher's k-statistic k r , the unbiased estimate of K r , is given there 
in Section 12.9 for r < 8 in terms of {s{ = n^{F) = Xy?=i^}}- Fisher's expressions for 
unbiased estimates of the joint cumulants of fc-statistics are given there in Section 12.16. 
Wishart's unbiased estimates of products of cumulants are given there in Section 12.16 in 
terms of symmetric functions, which can be converted to {sj} using Appendix Table 10. 

Generally one only wants approximations. (Indeed without making parametric assump- 
tions on F only approximations are possible except for estimating polynomials in moments). 
One problem with these "traditional" approaches is that it is not an easy task to separate 
out terms beyond the first in decreasing order of importance in order to make such approxi- 
mations. As noted in Section 3 the present approach does not suffer from this disadvantage. 

For S(F) a polynomial in F of degree r (for example, fj! r , [i T or K r ), derivatives of order 
beyond r vanish. 

Example 4.1 Suppose T(F) is a function of a univariate mean, say T{F) = g(n(F)). 
Setting = g( k \fi), Example 3.1 implies 

«21 = 5l>2, 

an = 52^2/2, 

^32 = 5lM3 + 3^x52^2) 

022 = 5152/^3 + (#!/ 2 + gi9z) A*2) 

043 = 9i (^4 - 3^) + 12g\g 2 ^2 + 4 (3gjg% + 55*53) l4- 
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For, 



T.\.., p — g p h\ 



■h 



where hi = X{ — /i. So, 



[1 • • • 1] = 9kVk if 1 • • • 
[1,2,12] = 9l 2 52/ ui, 
[1, 11] = 9192^3, 
[12 2 ] = <?|/4 
[1,122] =5133/^2, 
[1,2 2 ,12] =gfg 2 ^2 
[1,2,13,23] = 5 2 5 2 ^, 
[1,2,3,123] =g? 5 3M2- 



• 1 contains k 1 's. 



So, an estimate of g(/j,(F)) of bias 0(n 4 ) is given by \3.5\) with j = 3 in terms of 



For example, an estimate of [i r of bias 0(n ) is given by substituting gi = (r)j// 1 . If 
(j, > 0, r need not be an integer. However, regularity conditions generally breakdown ifr<0 
and F(0) / 0. 

Functions of non-central moments can be handled with similar ease. We now present an 
important result which was stated without proof in equation (4.1) of Withers (1987), the 
derivatives of a central moment. 

Theorem 4.1 For r, p in {1, 2, . . .}, the pth derivative of /U r (F) is 



S. X {F) = -92H2/2, 
S- 2 {F) = + 54^/8, 

S. 3 (F) = -54/X4/4 + 3g 4 /ul/8 - 55/^2/6 - g Q fj,l/A8. 



(~1) P { (r)pfJ-r-p ~ (r)p-i J2[h r i p - Hr-p+lK 



i=l 




where hi = xi — fx. 



Proof: As in Example 3.1, T{F) = /x fc /U J has derivatives 



■p ~ 




where 



9 P = (j)p^ p , U = n k , U.i = x\ - f/ k , S4 = Xi- [i. 
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But fi r = £fc= Q(-l) r - k fi k n r - k . So, 

fc=0 ^ ' I i=l 

J i=i 

Now simplify. □ 

Some particular cases of the theorem are given by the following corollaries. 

Corollary 4.1 We have 

fi r .i = h\ — n r — rhifx r -i, 

2 

fJr-12 = ~ r X] (^l" 1 ~~ h2 + ( r )2hlh 2 fJ- r -2, 

3 

Mr-123 = (r) 2 ^2 {K~ 2 ~ Mr-2) h 2 h 3 - (r) 3 /li/l 2 /l3^r-3, 

r-1 

Mr.l2..T-l = (-I)"" 1 (H/2) J] (/l? ~fl 2 )h 2 --- K-l, 
Mr-12-r = (-l) r (^ - ■ ■ ■ /l r , 

/x r .iP = (-l) p |(r)p^ r _ p /i? -p(r) p _i^ - /ir-p+i/i^ -1 } . 
Corollary 4.2 We /iaue 

A*2-i = to? - M2, 

M3i = /if — A*3 — 3/ll/i2, 

/X4-1 = ^1 - A*4 - 4/li/X3, 

A*5-i = hl- fi 5 - 5/11//4, 

M2-12 = -2/li/l 2 , 
2 

M3-12 = -3 ^ (/l? - //2) ^2, 
2 

/X4.12 = \1h x h 2 [i 2 - 4^ (/if - // 3 ) /i 2 , 
2 

/X5.12 = 20h 1 h 2 fi 3 - 5 ^ (/if - /i 4 ) /i 2 , 

M3-123 = 12/li/l 2 /l3, 

3 

M4-123 = 12 ^ (/l? - M2) ^3, 

3 

M5-123 = 20^ (/if - /i 3 ) /l 2 /l3 - 60/li/l 2 /l 3 , 

^4-1234 = 72/li/l 2 /l3/l4, 
4 

M5-1234 = 60^ (/if - /x 2 ) h 2 h 3 h4, 
/i5-12345 = -480/li/l 2 /l 3 /l 4 /l5. 
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So, for example, for T(F) = fi r , 

[l 3 ] T = H 3r - 3r/i 2 r+lA*r-l ~ 3/U 2 r^r + 3r 2 /i r+ 2/i r _i + 677Vfl/V/V-l 
+2// 3 - 3r 2 ^ r /i^_ 1 ^ 2 - r 3 /4-ifJ-3, 
[1, 2, 12] T = -/i 2r -i (2r/i r+ i + r 2 ^ r „i/i 2 ) + (r) 2 /i 2 +1/ u r _ 2 
-r 2 /i r+ i/x r /x r _! + 2r 2 (r - l)/x r+ i/x r _i/x r ._ 2 /i 2 
- (2r 3 - r 2 ) (j, r f4-ifJ>2 + r 3 (r - l)/x 2 _ 1 /i r _ 2/ u 2) 

giving 

a 2i = [ i2 ]t = r2 (4-1^2 ~ 2r/i r _i/x r+ i + /U 2r - /x 2 , 
an = [ll]r/2 = (r) 2/ u r _ 2 /x 2 /2 - r// r , 

a32 = M3r - 3r/i 2 r+lA*r-l - 3/x 2r/ u r - 3/i 2r _i (2r/i r+i + r 2 /i r _i// 2 ) 
+3r 2 /i r+2/ u 2 _ 1 + 3(r) 2 // 2 +1/ u r _ 2 - 3r(r - 2)/x r+ i/x 7 ./x r _i 
+6r 2 (r - l)/i r . + i/x r _i/i r _ 2 /i 2 + 2/x 3 - 3r 2 /i r /i 2 _ 1 /i 2 - r 3 /i 3 _ 1 ^ 3 . 

Similarly, estimates of // r for general r of bias 0(ra -3 ) are given by (|3 . 5f) in terms of 

[111]t = -(r) 3 /i r _3/x 3 + 3(r) 2 (/x r - /x r _ 2/ u 2 ) , 
[112% = (r) 4 /V-4/4 

For r = 2 this gives 

«2i = M4 - a4 on = -^2, a 32 = /i 6 - 3//4/X2 + 2/if, [lll]r = [112% = 0, 

and for r = 3 this gives 

021 = A*6 — 4^2 - m! + 9/i 2 , an = -3// 3 , 

«32 = A*9 - 9/U 7/ u 2 - 3/i 6 /^3 - I8/X5/X4 - 9/x 4 /x 3 /i 2 + 2/x 3 , 

[111] T = 12/i 3 , [1122] T = 0. 

Example 4.2 Suppose that r is an odd integer and F is symmetric. So, odd cumulants of 
Hr(F) are zero so that an = a 32 = and the Edgeworth- Cornish- Fisher expansions are in 
powers of n~ l , not just n -1 / 2 . Taking r = 3 gives for T(F) = /i 3 , 

[12 2 ] t = 2/x 2 (/x 4 -m1), 

[1, H] T = -6 [jj, 6 - 4/z 4/ u 2 + 3^) , 

[1, 122] T = 12/x 2 (/x 4 -3/x|), 

[l 4 ] T = /ii 2 - 12//io/i2 + 5/X 8 /X2 - 108/Z 6 A*2 + 81//4/4) 

[l, 2 2 , 12] T = -3/x 4 (/i 8 - 4^ 6 /i 2 + 6/i 4 /^ 2 - 3/4) , 
[1, 2, 13, 23] T = 9 (n4 ~ f4) (M4 " 3/xi) 2 . 

So, 

Q21 = A*6 - 6/i 4 /"2 + 9^2 j 

a 22 = -6 (/i6 - 7/i 4 /i 2 + 10/xl) , 

043 = A*i2 - 12/U10/U2 - Ms (72/x 4 - 5^1) - 3/U 6 (/i 6 - IO8/X4M2 + 54//|) 
+3/i 4 (52/il - 576/x 4 /x^ + 1179/4) - 2511/4- 

For F normal this gives a 2 i = 6/4; 022 = — 24/4, a4 3 = — 11625/4- 
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Example 4.3 This example is about standardized central moments. Suppose T(F) = v r , 
where v r = fi r /^ 2 - Then the []t needed for third order inference and bias reduction, are 
given by Example 3.4 with S = ^2 and U = fi r and 

9j = {-r/2)^- r/2 - j = r(r + 2)(r + 4) • • • (r + 2j - 2) (-2/x 2 )^' fi~ r/2 

in terms of [l 2 ]u> [H]t/> [l 3 ]i/, ■ ■ ■ and [l 2 ]s, [H]sj [I 3 ] 5; ■ ■ ■ given by Example 4-2 and the 
bracket functions 

[U.iS.!] = fJ, r+2 ~ 2fl r fJ, 2 - r/i r _i// 3 , 

[{7.1 = ^2r+2 — ^2r^2 ~ 2r/i r _i (fi r +3 ~ fi r +l^2 ~ l^r^z) ~ 2/X r+2 /X r 

+2/4^2 + r 2 f4-i (a»4 - M2) , 
[{7.1S 2 ] = ^ r+4 - 2/X r+2 /X 2 + /i r (-/i4 + 2^2) - »"A*r-l (M5 + 2/U 3 ^ 2 ) , 
[C/.i{7. 2 S'.i 2 ] = -2 (/i r+ i - r^, r _i^ 2 ) 2 , 

[{7.i5. 2 {7.i 2 ] = -rH2r-ifJ-3 - r/4+i + (r 2 + r) / u r+ i^ r _i / u 2 + (O2 ^+1^-2^3 

+ (r 2 + r) /x r // r _i// 3 - rVr-1^2 - (r - 1) ,u r _i^ r _ 2/ u 3/ [/ 2 , 
[{7.i5. 2 5.i 2 ] = 2 (-/V+1/X3 + r^, r „i^ 3/ u 2 ) , 
[5.i5. 2 {7.i 2 ] = -2rfj, r+1 n 3 + 4r^ r _i / u 3/ u 2 + (O2 /"r-2^ 3 , 

[C/.iS.il] = 2 (-/i r+2 + /U r ^2 + r// r _i// 3 ) , 

[J/.H^.i] = 2r (-/X r+2 + /i r A*2 + /V-1/U3) + (7)2 Mr-2 (a*4 - M2) > 

[I7.i5.i22] = 0, 

[{7.1225.1] = (r) 2 (/i r ^ 2 + 2/U r _i/i 3 - /X r _2M2 - ( r - 2) ^ r _ 3/ u 3/ u 2 ) , 
[{7.125.12] = 4r^ r/ u 2 - 2 (r) 2 n r - 2 fJ%. 

For example, suppose that r = 3 and F is symmetric. Then a r i = /or r odd and 

2 1 = ^6 — 6^4 + 9, 

a 22 = -3 (vg - 5z/ 6 + 7^4 - 3) + 12u 6 (2i/ 4 - 1) /4 

+2^4 (107^4 - 489) /4 + 9 (4i/ 4 - 11) , 
043 = ^12 — 12^io + 54^8 — 108^6 + 81 1/4 — 3a2i 

-18 (1* - 4^ 6 + 3^4 - 3) (i/ 6 - 4z/ 4 + 9) 

+27 (1/4 - 1) [ali + 4a 2 i (1/4 - 3) + 4 (i/ 6 (1/4 - 1) + 9)] 

+12 (1/4 - 3) 2 (3i/ 6 - 14z^4 + 15) . 

For F normal this is in agreement with Fisher (1931) who gave the result 

/x(-r,a 3 ,a 4 , ...) = // (03,04, . . .) (n - 1)7 {(n - l)(n + 1) ■ ■ ■ (n + 2r - 3)^} 

for /x(a 2 , a 3 , 04, . . .) = Effcj 2 ^ 3 ■ ■ ■ ]. 5ee Agostino and Pearson (1973) for a simulation 
approach. 

Figure 4-1 compares the bias reduced estimator of '1/3 versus the usual one by means of 
simulation. The biases of the estimators are computed by simulating ten thousand replica- 
tions of samples of size n from the following distributions: standard normal, Student's t 
with two degrees of freedom, Student's t with five degrees of freedom, Student's t with ten 
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degrees of freedom, standard logistic, standard Laplace. As expected, the bias reduced esti- 
mators give substantially smaller biases for each n and for each of the six distributions. The 
biases appear largest for the Student's t distribution with two degrees of freedom. The biases 
appear smallest for the normal distribution, the Student's t distribution with ten degrees of 
freedom, and the logistic distribution. 

As noted k r is the unbiased estimate of K r so &2 = /J,2(F)n/(n—l), and k 3 = /j, 3 (F)n 2 / '(n— 
l)(n-2). 

Example 4.4 Suppose T{F) = /U r / / u r ; where fi ^ 0. Then the [-]t needed for third order 
inference and bias reduction are given by Example 3.4 with gj = (— r).,-^ r ~ : ', S = fi, 
U = fi r , [1 2 ](7, [11]?7, [l 3 ]c/; • • • given by Example [l l ]s = Hi, the other non-zero leading 
terms needed for Example 3.3 being 

[U.xS.i] = fi r+1 - rfir-i^, 

[U^S.i] = H2r+i - 2rn r+ 2Hr-i - 2/z r+ i/x r + 2rfi r n r - 1 fi 2 + r 2 //r-iM3, 

[U^S 2 ]] = H r+ 2 - HrH2 ~ rfJ, r -!fl 3 , 

[U.1S.2U.12] = -rH2r-\V2 ~ rflr+lfJ-r + K 2r + l)/X r /V-l/X 2 
+ {r) 2 Hr-2 (MH-1jU2 ~ J"/i r _i/x|) , 

[S.1S.2U.12] = -2rn r fi2 + (r) 2/ u r _2M2! 

[U.nS.i] = -It (fl r +l ~ Mr-l/^) + (^2^-2^3, 

[U.122S.1} = 3(r) 2/ u r _i^2 - (r) 3 Hr-3l4- 
For example, the asymptotic variance of n l / 2 {T{F) — T{F)) is 

-2r (22 n , 2\ 

o — 2r— 1 / \ , 2 —2r~2 2 1 2\ 

-2rfl (/Ir+x - THr-!^) +T /J, /W r (^4-M 2 J- 

For r = 2, this reduces to T (F) 2 (/i^^ 2 — 1 — 4//3/x^" 1 fi' 1 + A^^ 2 )- 

1/2 

Example 4.5 This example is about the coefficient of variation. Suppose T(F) = \i 2 //•*• 
Then the [-]t needed for third order inference and bias reduction are given by Example 3.4 
with gj = (l/2)jfi^ 2 J ; S = fi2, U = fi^ 1 . By Example 4-1, U.\... p = (— ■ ■ ■ h p 
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so the terms needed in Example 3.4 are 

[! 2 ] u = M _4 M2, [U.iS.i] = -n~ 2 H3, [l 2 ] s = - l4, 

= 2 M - 3 /i 2 , [11] S = -2 M2) [l 3 ] [/ = -/x- 6 /X3, 
[£/ 2 S.i] = m~ 4 (M4 - , [I7.i5?i] = -V~ 2 (Ms - 2/x 3 /x 2 ) , 
[I 3 ] s = /x 6 - 3^ 4 /i 2 + 2/4 [1, 2, 12]^ = 2 A r 7 /x 2 , 
[£/.i£/. 2 S.i 2 ] = -2/i- 4 /i2, [^iS. 2 C/.i 2 ] = -2 / u- 5 /i 3 /i 2 , 
[f7.iS. 2 S.i2] = 2 / u~ 2 / u 3/ U2, 
[S.iS. 2 U. 12 ] = 2 / u~ 3 / u 2 , [1, 2, 12] 5 = -2/x|, 
[11% = -6/x- 4 /x 3 , [Hl] s = 0, [C/.iS.n] = 2^- 2 /is, 
[KiiS.i] = 2/i- 3 ( M4 - , [S.iS.n] = -2 (/i 4 - Ml) , 
[1122]^ = 24/x- 5 /x|, [H22] s = 0, [£/.iS.i 22 ] = 0, 
[l/.i225.i] = -6/i-Vl. [17-125.12] = -4/x- 3 Ail, 
[l,122] s = 0, [11 2 ] 5 = 4 M4 , [12 2 ] 5 = 4/x|, 
[17.iS.iS.i2] = 2fi- 2 fi 3 fi 2 - 

For example, 

02i = [l 2 ] = T(F) 2 {ii 2 pT 2 - fisfi- 1 ^ 1 + ^ 2 2 4- x - 4- 1 ) 
as gwen fry Section 10.6 of Stuart and Ord (1987). Also 

a n = [ll]/2 = T(F) (-3/8 - ^ W8 - M _1 MjVs/2 + /^V 2 ) , 

3 

[l 3 ] =T(F) 3 ^^-M,, 

i=0 

4 

[1,2,12] =T(F) 3 

4 

a 32 = T(F) 3 ^ /[ /- i C l , 

i=0 

w/iere 

A = 1/4 - 3^- V 4 /8 + ^Ve/8, 

A i = 3 (2/XJV3 - MjVs) /4, ^2 = 3 (-/x 2 + ^ 2 V4) /2, ^3 = -/X3, 

5 = - (1 - ^4) 2 /16 - /x 2 - 2 /x 2 /4, 

51 = MjVs/2, # 2 = -3^/2 + n^-in/l + 3^ 2 ^/4, B 3 = -3/x 3 , 
i? 4 = 2/i 2 , 

Co = 1/16 - 3n 2 2 n 2 3 /4 + ^ 2 3 ^ 6 /8 - 3^2 Vl/16, 

d = 3 (//J V 3 - M2 2 ^5/4) , C 2 = 3 (-/i 2 + V4 + 3//J V3/ 4 ) , 

C 3 = -IO/X3, C 4 = 6x4 
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Appendix A 

Continuing Example 3.4, the terms needed for (|3.8p - (|3.9p are: 

[i,n] T = 9 2 [1,11^ + g g 1 [u[S4U. u ] + u[u. 1 s. n ] 



2 r-i 3i 

5 



+2 [Uls.t] J +g g2U [U.tSl] +gig 2 U 2 [l 
[12 2 ] T = g 2 [12% + 2 5 o5i (u [U. 12 S. 12 ] + 2 [U4S.2U.j3] J 

+g 2 {u 2 [12 2 ] s + 4U [U+S.zS.u] + 2 [l 2 ] v [l 2 ] s + 2 [U4S4]' 
+2g g 2 U [S4S.2U.t2] + 2g l92 U (Z7[l,2, 12] s + 2 [U4S4] [l 2 ] 



[1, 122] T = g 2 [1, 122]^ + 5051 ^ [t/.i5. 122 ] + [l 2 ] v [H] s + 2 [t/.iC/. 2 5.i 2 ] 
+2 [CT.x5.atr.i2] + [Cr.x5.x] [1% + U [S4U422] ^ 
+5052 ( U [U4S4] [11] s + 2U [U4S.2S42] + [l 2 ] v [l 2 ] s + 2 [C/.^.x] 2 



+g g 3 U [U4S4] [1 2 ] s + g\u (u [l, 122] S + [S4U4] [li] s 
+2 [Cr.i5 2 5 12 ] + [l 2 ] 5 [ll] l/ + 2[5i5 2 rj.i 2 ] I +5i52C/[C/[l 2 ] 5 [ll 



S ^JS 



2 fi2l2 



+2C7 [1, 2, 12] s + [5.iCr. x ] [l 2 ] s + 2 [l 2 ] s [U4S4] j + 2 gm U 2 [l 

[1% = 50 + 45^51 U[U 3 1 S. 1 ]+ 6g 2 gj U 2 [U 2 X S\] 
+4g g!u 3 [tr. 1 5 3 1 ]+5 1 Cr 4 [l 4 ] 5 , 
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[1,2 2 ,12] T = gl[l,2 2 ,12] u + glg 1 \u[U. 1 U 2 2 S. 12 ] + [l 2 ] u [U 2 1 S. 1 ] 

+ [l 3 ] u [U. 1 S. 1 ] + 2U [U.iU^U.u] + U [U\S. 2 U. 12 ] ^ 
+glg 2 U [U+S.i] [U 2 ^] 

+g 2 g 2 u(^2U [U.^S^S.n] + 2 [l 2 ]^ [U.^] + 2 [C/.^-i] [tfi&i] 

+*7 [C/.iS 2 2 C/.i 2 ] + c/ [t/is. 2 5. 12 ] + [l/.i&i] [c/.i^.i] + [1% [i 2 ] 5 j 
+5oV52f/ 2 ^2[^. 1< S. 1 ] [t^] + [C/.i-Sa] [i 2 ] 5 j 

+W^ 2 ^ [t/.i5 2 2^i 2 ] + [l 2 ]^ [1 3 ] 5 + [U.iS.i] [U.iSl] + 2U [5.i5 2 2 17.i 2 ] 
+Ws 2 £/ 3 [C/.^.i] [l 3 ] s 

+2^[/ 3 ^ [1, 2 2 , 12] s + [E/.x&i] [I 3 ] s + [U^S 2 ,] [l 2 ] s j 
+2^[l 2 ] 5 [l3] 5 Y 
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gt [1,2,13,2% 

+glgi\2U [U.1S.2U.WU.23] + 2U [U4U.2U.wS.23] + 2 [U4S.2U42] [u\] 



+2[U 1 S. 1 ] [1,2, 12]^^ 

+9I9I (u 2 [S4S.2U.uU23] + 2U 2 [U4S.2U.23S43] + 2U 2 [U4S.2U43S.23] 

+2U [l 2 ] v [S4S.2U42] + 4U [U4S4] [U4S.2U42] + 2U [1, 2, 1% [l 2 ] s 
+U 2 [U4U.2S43S.23] + 2U [U4S42S.2] [l 2 ] u + 2U [U4U.2S42] [U4S4] 

+ [1 2 ]^[1 2 ] 5 + 3[C/,5. 1 ] 2 [l 2 ]^ 

+2g ogi u(u 2 [S4S.2U43S.23] + U [U4S4] [S4S.2U42] U [U4U42S.2] [l 2 ] s 
+U 2 [U4S.2S43S.23] + U [l 2 ] v [1, S.2, 12] s + 2U [U4S.2S42] [U4S4] 
+U[U. 1 U. 2 S. 12 ] [l 2 ] s + 3[l 2 ] u [U 1 S. 1 ] [l 2 ] s + [U.iS4] 3 ^j 
+2glg 2 U [U4S.2U42] [U4S4] 

+2g 2 g l9 2 (u 2 [U4S4] [S4S.2U42] + U 2 [U4S.2U42] [l 2 ] s + U 2 [U4S.2S42] [U4S4] 
+U [l 2 ] ^[l/.i^.i] [l 2 ] s + U[U4S4f^j 

+2g g 2 g2U 2 (u [S4S.2U42] [l 2 ] s + U [U4S4] [1, 2, 12] S + U [U4S4S42] [l 2 ] s 
+ 3[U4S4] 2 [1 2 ] S+ [1\[1 2 ]) 



i2 



+2gfg 2 U 3 \U [l 2 ] g [1, 2, 12] s + 2 [U4S4] [l 2 ] 2 

+2 50 5i52 2 ^ 3 [tfi&i] [I 2 ]!, 
+g 2 g 2 U* [l 2 ] 3 A 
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g 4 [1,2,3,12% 

+g 3 9i (u [C/.1C/.2C/.3S.123] + 3 [l 2 ] v [lJ.tU.2S.t2} + 3 [1, 2, 12] v [U.tS.i] 
+3U [U. 1 U. 2 S. 3 U. 1 2 3 ] S j 

+<?o<?2 (^U [t7.1l/.2S.12] + 3 [l 2 ] v [f/.iS.i] 2 j 

+3 5 g<7?E^E/ [i7.iC/.2S.3S. 123 ] + 2 [l 2 ]^ [U+S.zS.n] + [l/.iS.i] [tf.1l/.2S.12] 

+2 [C/.iS.i] [tf. iS 2 tf 12] + [1, 2, 1% [l 2 ] 5 + 17 [i7.1S.1S.3i7.123] j 

+35o5i5 2 f/^2?7 [C/.1S.1] [C/.iS. 2 S.i 2 ] + U [tf.1tf.2S.12] [l 2 ] s 

+2 [lV^.iS.i] [l^ + If/.xS.!] 3 ^) 
+35offi53t/ 2 [f/.iS.i] 2 [1 2 ] 5 

+gog\U 2 (^U [i7.1S.3S3S.123] + 3 [l 2 ]^ [SiS.2S.i2] + 6 [C/.1S.1] [i7.1S.2S.12] 
+3 [C/.1S.1] [S.1S.2C/.12] + 6 [tf. iS 2 tf 12] [S 2 !] + tf [S.1S.2S.3C/.123] j 
+3 5 o5 2 52t/ 2 ( tf [C/.1S.1] [1,2, 12] s + 2U [tf1S.2S.12] [l 2 ] s 



+gfU 3 U [1, 2, 3, 123] s + 3 [f/.iS.i] [1, 2, 12] s + 3 [S.iS. 2 tf 12] [l 2 ] s 




+3 5 05 2 53f/ 3 [f/.iS.i] [l 2 ] 2 
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Appendix B 

Here, we give bracket functions for moments to order seven, that is expressions for 
(l«ll*2fl2^ -..)= T ... T ■■■dF 1 (xi) dF 2 (x 2 ) ■ ■ ■ 

J —CO J —CO 

up to N = ar + bs + ct + ■ ■ ■ = 7, where now \i\ means \i. This enables one to obtain 
the Edgeworth-Cornish-Fisher expansions and bias reduction for any smooth function of 
(/j,, H2, IJ.3, ■ ■ .)■ We exclude separable terms like (1 2 2 2 ) = (1 2 )(1 2 ). For each N, we order 
the terms by its partition functions. 

N = 2 (2 terms) : 

1 2 : (1?) = M2, 

2 : (11 2 ) = -2/x 2 . 
N = 3 (5 terms) : 

1 3 : (1?) = M3, 

12 : (lil 2 ) = a*3, (I1II2) = -2/X3, 

3 : (11 3 ) = -6/X3, (HI3) = -12/i 3 . 
AT = 4 (13 terms) : 

1 4 : (If) = M4, 

1 2 2 : (1?1 2 ) = /x 4 - A*!, (l?ll2) = -2/X4, 

13 : (I1I3) =m- ill (I1II3) = -6 (a*4 - M2) , (I1IH3) = 12/X4, 

(11122 3 ) = 12/xl, 

2 2 : (l 2 ) =fH - M 2 , (1 2 11 2 ) = -2 ( M4 - M2) . (H|) = 4/*4, (12|) = 4 M 2 , 

4 : (IIII4) = -72^4, (1122 4 ) = -72/z 2 ,. 
iV = 5 (43 terms) : 

1 5 : (If) = M5, 

1 3 2 : (1?1 2 ) = Ms - M3M2, (1?H 2 ) = Ms - 2^2, (l 2 2il2 2 ) = -2/i 3 M2, 

1 2 3 : (1?1 3 ) = M3M2, (1?H 3 ) = -6 (a* 5 " M3/x 2 ) , (1?H1 3 ) = 12/i 5 , 

(l 2 122 3 ) = 12/X3M2, (Ii2il2 3 ) = -2/xi, (Ii2ill2 3 ) = 12/x 3 /x 2 , 
12 2 : (hi 2 ) = n 5 - 2/x 3 /x 2 , (I1I2II2) = "2 (/i 5 - ^2) , (li2 2 12 2 ) = 4^2, 

(lilll) =4 M5 , (lil2l) =4^2, 

14 : (I1I4) = /i 5 - 4^ 3/ u 2 , (I1II4) = -8^5 + 20^ 3/ u 2 , 

(111114) = 36 (n 5 - /i 3 /z 2 ) , (I1IIH4) = "72^5, 

(11122 4 ) = 6^ 3/ u 2 , (lill22 4 ) = -72^ 3/ u 2 , 
(lil222 4 ) = -72/x 3 /x 2 , 

23 : (I2I3) = M5 - 4^ 3/ u 2 , (1 2 11 3 ) = -6 (/x 5 - // 3 // 2 ) , (I2IH3) = 12 (^5 - ^3^2) , 

(H2I3) = "2 (Ms - 4^ 3/ u 2 ) , (II2II3) = 12 (a* 5 " M3M2) , (H2HI3) = "24^5, 
(11 2 122 3 ) = -24^3^2, (12 2 H2 3 ) = -24^ 3/ u 2 , 

5 : (11 5 ) = -10 (us - 2fi 3f i 2 ) , (111 5 ) = 60 (/x 5 - 2^ 2 ) , (IIII5) = -240 ( M5 - ^ 3/ u 2 ) , 

(111115) = 480^, (H22 5 ) = 0, (11122 5 ) = 480/X3M2- 
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6 (85 terms) : 
(1?) = A*6, 

(I1I2) = M6 " M4M2, (I1II2) = -2/U 6 , (l?2il2 2 ) = -2/i 4 /Z 2 , 

(1?2?12 2 ) = -2/4 

(il^) = M6 — 3/"4^2 - /4 (I1H3) = -6 (/X6 - M4M2) , 

(ifllls) = 12/x 6 , (l?122 3 ) = 12^4^2, (l?2il2 3 ) = -3 (^2 + nl ~ f4) , 

(122x112s) = 12/x 4M2 , (l?2il22 3 ) = 12/4 (Ii2i3il23 3 ) = 12/4 

(ljU) =H6- 4// 4 /i 2 - 4/4 (I1II4) = -4 (2^6 - 3^ 4 /U2 - 2/i|) , 

(1?111 4 ) = -12 (Ate " M4M2) , (lfllll 4 ) = -72/*, 

(1?122 4 ) = -12 (^ 2 + 2/z§ - fil) , (1?1122 4 ) = -72^ 4/ u 2 , 

(1?1222 4 ) = -72/4 (1 1 2 1 12 4 ) = -4 (2/x 4 /x 2 - 3/4 , 

(1 1 2 1 112 4 ) = -12 (2/X4/x 2 + //| - 2/xi) , (li2 1 1112 4 ) = 480/x 4 /x 2 , 

(Ii2ill22 4 ) = 480/x§, (Ii2il233 4 ) = 480/4 

(If 111) = 4/*6, (1?12|) =4/x 4 /x 2 , (1 1 2 1 11 2 22 2 ) = 4/x|, 

(l 1 2 1 12l) = -2/4 

(I1II2IH3) = -24/x 6 , (lill 2 122 3 ) = -24/x 4 /x 2 , 
(lil2 2 112 3 ) = -24/x 4 /x 2 , (lil2 2 122 3 ) = -24/4 
(lil2 2 222 3 ) = -24/x 4 /x 2 , 

(I1I5) = A*6 - 5/x 4 // 2 , (I1II5) = -10 (/t 6 - /U4M2 - 2/t§) , 

(I1IH5) = 60 (/x 6 - /t 4 /t 2 - /*§) , (lil22 5 ) = 6O/MM2, 

(I1IIII5) = 240 (/x 6 - /x 4 /x 2 ) , (lill22 5 ) = 120 (/x 4 /x 2 + f4 - nl) , 

(lil222 5 ) = 60 (3/X4M2 + Ma - , (I1IIHI5) = 480/*, 

(lilll22 5 ) = 480//4/U2, (lill222 5 ) = 480/4 

(lil2222 5 ) = 480/x 4 // 2 , (lil2233 5 ) = 480/4 

(l 2 ) = /t 6 - 3/i 4/ u 2 + 2/4 (1 2 1 2 11 2 ) = -2 (/t 6 - 2/i 4 /x 2 + /t 2 ) , 

(1 2 2 2 1 2 ) = 2/4 (l 2 ll|) = 4 (/i 6 - /X4/X2) , 

(l 2 12l) = 4 (/X4/x 2 - , (H|) = -8/x 6 , 

(II2I2I) = -8/X4/X2, (12 2 23 2 31 2 ) = -8/4 

(I2I4) = /*6 - M4M2 - 4/4 (I2II4) = -4 (2/z 6 - 3/x 4 /i 2 - 2/tg + 3/x 2 ) , 
(I2IH4) = -36 (/* - + 2(4) , (I2IIH4) = -72 (/* - // 4 // 2 ) , 

(1 2 H22 4 ) = -72 (/X4/X2 - Ml) , (H2I4) = -2 (a*6 - M4M2 " 4/i|) , 
(II2II4) = 8 (2/x 6 - 3/X4M2 - 2/x|) , (II2IH4) = 72 (n e - M4M2 ) , 
(II2IIH4) = 144/x 6 , (11 2 1122 4 ) = 144/x 4 /x 2 , 

(12 2 12 4 ) = 8 (2/X4/x 2 - 3/i|) , (12 2 112 4 ) = -4 (2/x 4 /x 2 + n\ - 2^) , 
(12 2 1112 4 ) = (12 2 1122 4 ) = 144/4 

(4) = Me - 6/i 4 /t 2 - /ig + 9/4 (I3II3) = -6 (/* - 4/x 4/ u 2 - /x 3 + 3/x 2 ) , 
(I3IH3) = 12 (/x 6 - 3/z 4 /x 2 - m!) . (I3I223) = 12 (// 4 // 2 - 3/4 , 
(II3I223) = -72 (/x 4 /x 2 - /x|) , (12§) = 18 (/X4/x 2 + n\ - 3) , 
(12 3 112 3 ) = -36 (/X4M2 + Ms - f4) , 
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6 : (11 6 ) = -6 (2/z 6 - 5/x 4 /x 2 ) , (Hie) = 30 (3/x 6 - 3^ 4 /«2 - 4/Xg) , 

(1111 6 ) = -120 (/ia - ^4M2 + A*§) . (mile) = -1800 (/x 6 - ^2) , 
(11226) = -120 (4^ 4 /U2 - 3/i|) , (11122 6 ) = -360 (3^2 + 2$ - 3^) , 
(111111 6 ) = -3600^6, (1111226) = -3600^2, 
(1112226) = -3600/4 (112233 6 ) = -3600/4 



24 



As noted for N = 2 
terms. We now give 

N = 7 
2 2 3 : 
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, . . . ,6 there are 2,5,13,43 and 85 terms, or without fi, 1,2,6,20 and 39 
the 90 terms for N = 7 without fi. 

I2I3) = A*5 - 4/U 3 /i2, 

= -6 (m ~ 3/i5At2 + 3//3A*i) » 
llllla) = -24 M5 , 
1^1223) = (1 2 2 2 122 3 ) = -24/^2, 
I2II2I3) = 2 (3^ 5 /X 2 - Ai4M3 + M3) . 
I2II2II3) = 12 (// 7 - 2^ 5/ u 2 + M3M2) > 
I2II2IH3) = -24(/x 7 -/X5/x 2 ), 

121121223) = -12 (^5-M3M2)^2, 

1 2 12 2 2 3 ) = 4 (/x 4 - m!) M3, 
1 2 12 2 12 3 ) = 6 (^ 5 /i 2 - 2/X4/X3) , 
1 2 12 2 112 3 ) = -24 (ji 5 - M3 /x 2 ) /i 2 , 
1 2 12 2 122 3 ) = -24 (fi 4 -nl)fi 3 , 
1 2 12 2 222 3 ) = -24^3, 
1 2 12 2 233 3 ) = -24fi 3f il 

I2I5) = - - 5/i 4 /U 3 , 

I2II5) = -10 (/i 7 - /i 5 /i2 + 3/i 4 /U3 - 2// 3 /Li|) , 

I2IH5) = 60 (/x 7 - 2/z 5 /i 2 - M4A*3 + 2/i 3 A* 2 ) , 

1 2 122 5 ) = 20 (/X5/X2 + 2/i 4 /x 3 - 4/x 3 /x|) , 

I2IIH5) = (I2IIUI5) = 480 ( M7 - ^2) , 

1 2 1122 5 ) = 120 (/i 5 /i 2 + ^4^3 - 3^3//|) , 

1 2 11122 5 ) = (11 2 11122 5 ) = 480 (/i 5 - /i 3 /i 2 ) M2, 

1 2 11222 5 )= (11 2 11222 5 )= - (12 2 1122 5 ) = 480 (// 4 - ^) fi 3 , 

1 2 12222 5 ) = (11 2 12222 5 ) = 480^3, 

1 2 12233 5 ) = (11 2 12233 5 ) = 480/^1. 

H2I5) = -2 (M7 - A*5A*2 - 5/i 4 /"3) , 

11 2 11 5 ) = 20 (^7-3^3), 

II2IH5) = -120 (/x 7 - /x 5 /i 2 - /x 4 /i 3 ) , 

11 2 122 5 ) = -40 (/x 5 /x 2 + 2/x 4 /i3 - 4/x 3 At|) , 

II2IIH5) = 240 (n 7 - 2^ 2 + n 3 n 2 2 ) , 

11 2 1122 5 ) = 120 (// 5 /i 2 + //4A*3 - 3//3M2) > 

II2IIIH5) = 480(^-^2), 

12 2 112 5 ) = -40 (2/i 5 // 2 + M4M3 - 5// 3 //|) , 

12 2 1112 5 ) = -120 (3// 5 /i 2 + M4M3 - 3/Lt 3 M 2 ) , 

12 2 1222 5 ) = -120 (3/^2 + M 4/ u 3 - 3^ 2 ) , 

12 2 11112 5 ) = -960/i 5/ u 2 , 

12 2 11122 5 ) = -960/i 4/ u 3 , 

12 2 12233 5 ) = -960/i 3 ^, 
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34 : (I3I4) = fJ-7 ~ 3/x 5 /x 2 - 5/z 4 /i 3 + 12^3/«2> 

(I3II4) = -4 (2// 7 - 9// 5 // 2 - 4^4^ 3 - 18/i 3 //|) , 

(I3III4) = -36 (n 7 - 4fJ, 5 [I 2 ~ + 4// 3 //|) . 

(I3IIII4) = 72 ? - 3^ 5/ u 2 - ^3) , 
(1311224) = 72 (fig -4^ 3/ u 2 )^2, 

(II3I4) = (H3II4) /4 = -6 (/i 7 - ^5^2 - 4/X4/x 3 + 4/x 3 /x|) , 
(II3III4) = 216 (n 7 - 2/i 5 // 2 + ^3^2) . 
(II3IIH4) = 432 (mt - A*5M2) , 
(II3II224) = 432( M5 -H3H2)H2, 
(II3II2224) = 432 (M4-A*l) M3, 
(12 3 12 4 ) = 24 (/z 5 // 2 + M4M3 - 5// 3 /z|) , 
(12 3 112 4 ) = 24 (n 5 fi2 + A*4A*3 - 4// 3 //|) . 
(12 3 1112 4 ) = (12 3 1222 4 ) = 216 (^2 + ^3 - Haiti) , 
(12 3 1122 4 ) = 432 ( M4 - ^1) /i 3 , 
(12 3 1233 4 ) = 432/x 3 /xl, 
7: (11 7 ) = -14(/x 7 -3/X5/i 2 ) , 

(lily) = 42 (3^7 - 3/ig/i 2 - 5/X4/X3) , 
(IIII7) = -840(^-2^3), 
(1122 7 ) = -140 (4^2 - Sn 3 H 2 2 ) , 
(IIIII7) = 840 (5^7 - 3^2 - 5/X4M3) , 
(11122 7 ) = 420 (3/i 5 /i 2 + 2^ 4 /U3 - 6^2) , 
(IIIIII7) = 15120(^-^2), 
(111122 7 ) = 7! (2/X5/X2 + ^4^3 - 2^3Mi) , 
(111222 7 ) = 15120 (n4 - nl) M3, 
(112233 7 ) = 15120a*3A*2. 
(IIIIIII7) = 30240^7, 
(IIIII227) = 30240^2, 
(1111222 7 ) = 30240^4^3, 
(1112233 7 ) = 30240^2- 

For F symmetric terms corresponding to odd N reduce to zero. 
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Figure 4.1 Biases of the usual (black) and bias reduced (red) estimators of skewness versus 
n = 2,3, ...,100. 
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